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Abstract 

We introduce the concept of Random Multi-Overlap Structure 
(RaMOSt) as a generalization of the one introduced by M. Aizen- 
man R. Sims and S. L. Starr for non-diluted spin glasses. We use 
such method to find generalized bounds for the free energy of the 
Viana-Bray model of diluted spin glasses and to formulate and prove 
the Extended Variational Principle that implicitly provides the free 
energy of the model. Then we exhibit a theorem for the limit- 
ing RaMOSt, analogous to the one found by F. Guerra for the 
Sherrington-Kirkpatrick model, that describes some stability prop- 
erties of the model. Last, we show how our technique can be used to 
prove the existence of thermodynamic limit of the free energy. The 
present work paves the way to a revisited Parisi theory for diluted 
spin systems. 

Key words and phrases: diluted spin glasses, overlap structures, cavity 
fields, generalized bound, extended variational principle. 

1 Introdution 

The diluted mean field spin glasses are important both for their correspon- 
dence to random optimization problems and for their sort of intermediate 
nature halfway from idealized mean field models to short range realistic 
ones, thanks to the finite degree of connectivity. 

Among the few rigorous results obtained so far in diluted spin glasses, 
two important examples are ref. where S. Franz and M. Leone found 

bounds for the free energy of diluted spin systems, considering the first level 
of Replica Symmetry Breaking; while D. Panchenko and M. Talagrand 

* Department of Mathematics, Princeton University, Fine Hall, Washington Road, 
Princeton NJ 08544-1000 USA <lde(amath.princeton. edu> 



1 



found a way to consider any level Broken Replica Symmetry Bound in 
a compact way, using a weighting scheme inspired by ref. In the 

high temperature region, rigorous results have been obtained for the K-Sat 
model of diluted spin glass by M. Talagrand^^ and by F. Guerra and F. L. 
Toninelli for the Viana-Bray model'^. 

In the case of non-diluted models, M. Aizenman, R. Sims and S. L. Starr 
recenlty introduced the concept of ROSt (Random Overlap Structures) 
through which they found bounds for the free energy in a very elegant 
and easy manner. In the same important paper^, the authors expressed 
the solution through an Extended Variational Principle. An important 
restriction of the ROSt space has been done by F. Guerra'^, exhibiting 
invariance of the limiting ROSt under certain transformations. 

After the introduction of the basic definitions in section |21 we extend 
the ideas of ref. [T] to diluted spin glasses, in section O The finite con- 
nectivity requires that we consider Multi-Overlap as opposed to Overlap 
Structures (because the couplings are not Gaussian). In section 0] we prove 
a generalized bound for the free energy of the Viana-Bray model, by means 
of an interpolation not based on the iterative approach of ref. 6^ used to 
find bounds in ref. OIH]. Rather, our interpolation is closer to the one 
used for non-diluted models in ref. As a consequence we can (like in 
ref. ^) formulate an Extended Variational Principle for the free energy. 
The next natural step we performed, in section|Sl is the search for invariant 
transformations of the optimal limiting RaMOSt, and we found stability 
properties similar to those found for non-diluted systems in ref. 0. Ap- 
pendix is devoted to a calculation that plays a basic role throughout 
the paper, Appendix IbI contains a somewhat new proof of the existence of 
the thermodynamical limit of the free energy. Appendix [CI reports some 
comments about optimal versus non-optimal RaMOSt 's in terms of the 
phenomenon of overlap coalescence and generalized trial functions. 

2 Model, Notations, Definitions 

We refer to ref. 4 for an introduction to the Viana-Bray model, a physical 
description, the role of replicas and multi-overlaps, the infinite connectivity 
limit and the connection to the Sherrington-Kirkpatrick model, the behav- 
ior in the annealed region. 

We will have in mind a lattice with a large bulk of N sites (cavity) and M 
additional spins {N is large and M is fixed). 
Notations: 

a,P, h are non-negative real numbers (degree of connectivity, inverse tem- 
perature and external field respectively); 
is a Poisson random variable of mean ^; 
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arc independent identically distributed random variables, uni- 
formly distributed over the cavity points {!,..., N}; 

{jv}, {kv} are independent identically distributed random variables, uni- 
formly ditributed over the added points {!,.... M}; 

{ Jy}, { J;^}, { Ji,}, J are independent identically distributed random vari- 
ables, with symmetric distribution; 

Jj is the set of all the quenched random variables above; 
a : j ^ aj = ±1,T : i ^ Ti = ±1 are the added and cavity spin config- 
urations respectively; p. will be used for the spins in the full lattice (the 
points of which are denoted by r, s) without distinguishing between cavity 
and added spins; 

7r^(-) is the Poisson measure of mean (. 

E is an average over all (or some of) the quenched variables; 
(jjj is the Bolztmann-Gibbs average explicitly written below; 
Qk is a product of the needed number of independent identical copies 

(replicas) of luj, in a system with K spins; 

(•) will indicate the composition of an E-type average over some quenched 
variables and some sort of Boltzmann-Gibbs average over the spin vari- 
ables, to be specified each time. 

We will often drop the dependance on some variables or indices or slightly 
change notations to lighten the expressions, when there is no ambiguity. 
In absence of external field, the Hamiltonian of the system of M sites is, 
by definition 

Hm{o',oc;J) = - ^ J^o'j^cTk^ 
i/=i 

When there is an external field h, the Hamiltonian is Hm + H^*, where 

we used the definition H'^^{a^ h) = — /iX^^i '^i- 

We follow the usual basic definitions and notations of thermodynamics for 
the partition function and the free energy per site 

Zm(/3, a, h;J) = Y. eM-P{HM{a, a; J) + H<§'{a, h))), 

~pfMiP,a,h) = -^ElnZM(/3,a; J) 
and / = limAf Jm- 

The Boltzmann-Gibbs average of an observable O is 
uj{0) = Zm{P, a, h; J)-' ^ 0{a) eM-P{HM{<T, a; J) + H^^\a, h))) 
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The multi-overlaps are defined (using replicas) by 

N M 
1 (1) (n) ~ 1 (1) (n) 

i=l j=l 

We are going to use the two following independent auxiliary Hamiltonians: 

Pa:M 

k{t, a;J) = -Y Xn^n^ (1) 

v{t, a,a-J) = - ^ .Ln^cTj^ = Vj<^j (2) 
i/=i j=i 

where 77^ is the Cavity Field acting on aj defined by 

v=l 

and the index j of Jl and r^j de-numerates independent copies of the 
corresponding random variables. 

The two expressions of rj define the same random variable, but the first 
is probably the most convenient for the calculations in next two sections, 
while the second describes better the physics of the model, and will be 
essential in section |S1 

3 Generalized Bound for the Free Energy 

For t G [0, 1], consider the following Interpolating Hamiltionian 

H{t) = HM{ta) + K{ta) + r/((l - t)a) + Hlf 
and using a set of weights ^7- define 

Call Gm the value of i?M at i = 

1 Er<TCrexp(-/3(7y-)-i/|f )) 

then 

-Rm(O) = Gm 
Rm{1) - -/3/a/ 
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Theorem 1 (Generalized Bound) 

-/3/ < lim inf Gm 

Proof 

The proof is based on Lemmas] Appendix El 
Define 

mi 7712 m3 

T(TOi,m2,m3) = exp(/3(^ Jt.(Tj„(Tfc„ + ^XTi,,Ti^ +^ J:^n^<^],.)) (4) 

1^—1 v—1 y—l 

Let us compute the i-derivative of i?A/, keeping in mind that its denomi- 
nator does not depend on t. 

— i?M i = — — Eln ■ — — = 

dt dt M exp(-/5K) 

1 "''^ d 

X] ^'^toAf(™l)7rtaA/(™2)7r(i_t)2aM(™3)IEhl^^^T(rni,m2,TO3) 
{m.} T,o- 

Now we have the sum of three terms, in each of which one of the tt's is 
differentiated with respect to t. As in Appendix 1X1 we can substitute into 
the first term the foUowing relation 

T(mi,m2,m3) = exp(/5JmiCrj^^ tTfc^, JT(mi - 1, 7712,7713) 

and we can do the same for the other two terms. 

It is clear then that as in Lemma ^ of Appendix El we get an average 
J with weights consisting of the weights times the Boltzmann-Gibbs 
weights associated to H{t): 

a[Eln fi^^t exp(/?Jo-j (Tfc )+Eln fi^^t exp(/3jTi r; ) — 2E Inil^^i exp{l3JTi (Tj )] 

According to Appendix IXI we will get now some terms in cosh(/3J), such 
terms can be factorized out, but here they are cancelled since they sum up 
to zero. Since 

E ^f(a, afe ) = ,E ) ^ ^^2^^ co^'^ina,) = (g2„g2n)t 

following the last steps of Lemma we finally get 

-i?A/(t) = -a^ — Etanh2"(/3J)((g2„ - <72„)')t (5) 

n=l 
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Thus 

which implies i?Af(l) < Rm{0) , i-c 

-pfM < Gm 

for all ^ and M, hence 

-/3/M<infGM □ (6) 

Notice that we could obtain the same bounds using any other rj and k 
leading to the bound lO- Even more is true, we could pre-assign the values 
qn and forget that they are overlaps of configurations in a lattice with N 
spins, which therefore is not an essential setting. Such remark explains the 
introduction of the following^] 



Definition 1 A Random Multi-Overlap Structure TZ is a triple (S, {qn}, 
where 

• T, is a discrete space; 

• ^ : S — > ]R_|_ is a system of random weights; 

• qn '■ — > [0,1], n S N, \q\ < I is a positive definite Multi-Overlap 
Kernel (equal to 1 only on the diagonal ofT,"). 

Sometimes one considers the closure of S, which is not discrete in general. 
For any RaMOSt one takes a couple of auxiliary random variables compat- 
ible with the Multi-Overlap Kernel and with ® , and the previous theorem 
could be stated^ as 

-/3/m <inf Gm (7) 

The generality of the RaMOSt allows to take S (which is not necessarily 
{— 1, 1}^) as the set of indexes of the weights G S constructed by 

means of Random Probability Cascades of Poisson-Dirichlet processes (see 
e.g. ref. [1]). A well known property of these Cascades (see e.g. equation 
4.2 in ref. 0) gives place to a chain of expectations of Parisi type (see e.g. 
equation 5.5 in ref. that coincides with the Parisi Replica Symmetry 
Breaking theory if one interpolates according to the iterative approach of 
ref. [HI , like in ref. EI ■ Since we interpolate with different auxiliary 
Hamiltonians, in our case (taking identical copies of 7]"^ and in Q and 
summing also over 7) the chain of expectations is not equivalent to the 
Parisi Replica Symmetry Breaking in the sense of This point will 
be deepened elsewhere''^. In order to get the Parisi Replica Symmetry 



6 



Breaking theory in the traditional sense, one should take (like in ref. ^ 
for non-diluted models) a sequence of suitably chosen 77^ and such that 
the corresponding bounds would be the special realization of (jT)) with the 
Parisi RaMOSt, like in ref. T for non-diluted models. 



4 Extended Variational Principle 

We can express the free energy of the model in the form of the following 

Theorem 2 (Extended Variational Principle) 

—f3f = lim inf Gj\/ 

In order to prove the Extended Variational Principle, we will find, in The- 
orem El below, the opposite bound to Q, like in ref. p. 
Notice first that the following Cesaro limit can be easily computed 

Climi-Eln^^ = -/3/ (8) 

N M Zn 

since, thanks to the cancellation of the common terms of the numerator 
and denominator 

K=l 

^ ^ (E In Zn+m + • • • + E In Zjv+i - E In E In Zm) (9) 

and the first M terms, with the positive sign, tend to — /?/; while the others, 
with the negative sign, vanish in the limit. 
Theorem El will be proven if we prove the following 

Theorem 3 (Reversed Bound) 

— Bf> lim inf Gm 

Proof 

If we prove the statement for the restricted RaMOSt space of the 7^'s such 
that is ^ the Boltzmann-Gibbs factor 

ir = eM-P{HN{T) + H%-\t))] = (10) 

then the theorem will hold a fortiori. Hence, given it is enough to show 

^'TJi"^'^^ ^ li-i-f Gm|,..,„ (11) 
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We can re- write Gm as 

Er.aexp(-/3(gAf+T?)) ZN+M{a') ZN+M{a) ZN{a) 

ZN+M{a') ZN+M{a) Zm[oi) Y.r^'y^I>[-P[HN + n)) _ 

therefore we have four terms. 

The rest of the proof is very similar to the proof of Theorem 01 in the next 
section. 

Recall that the sum of Poisson random variables is a Poisson random vari- 
able with mean equal to the sum of the means. So if we take 

{N + M) 

we see that the forth fraction is the same as ZN{a)/Z]\f{Q:'). Furthermore, 
since a'{N + M) - a{N + M) = a'N - aN, a' a, in the hmit the second 
and forth fractions cancel out thanks to Lemma ^ in Appendix 1X1 
We have seen that the third fraction tends to — /?/. 

Now we proceed with a key step of our approach. In the denominator 
of the first fraction we can split the mean a'{N + M) into the sum of three 
means such that m splits into the sum of three Hamiltonians with the 
first depending only on cavity spins r, the second containing interactions 
between the cavity and the added spins, the third has the added spins only. 
In other words, we are considering the fraction of the interactions (indexed 
by v) within the cavity, between the cavity and added spins, within the 
added lattice respectively. Hence the new three means will be proportional 
to N^,2NM,]VP respectively. More explicitly 

ZN+M{a') = ^exp(/3 ^ JuPr^Ps^) = 

p- p~ P- 

exp/3(^ Jun,ri^ -I- ^ Jvn,,cfj^ + ^ JvC^j^(^k) 

r,cr IX— 1 w—l w—l 

where 

X , A/"^ t , 2NM , M2 

^ N + M ' ^ N + M ^ N + M 

The third Hamiltonian is thus negligible. This means that when the cavity 
is large the added spins do not interact one another. 

The choice of a' we made guarantees that numerator and denominator 
contain two (up to a negligible third in the denominator) identical Hamil- 
tonians with the same connectivities. As a consequence, the first fraction 
in Gm vanishes in the limit and the theorem is proven. □ 
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5 Limiting RaMOSt Invariance 

As in Appendix 1X1 

A = Elncosh(/3J) - ^ — Etanh2"(/3J)(g2^) 



2n 

n=l 



Then we can state the fohowing 



Theorem 4 In the whole region where the parameters are uniquely defined, 
the following Cesaro limit is linear in M and a 

CUmElnJ7Ar{^exp[-/3(?7(a) +K(a))]} = M{-Pf + aA) +aA (12) 
Proof 

The proof is based on the comparison between the hmit above and 0, 
similarly to the method of the previous section. More precisely, the left 
hand side of H12|l can be re-written (without the limit) as 

Y^T^a- ^(0' PaN+a,P2aM) Zjv+M(a') ^JV+J\/(a) 



Eln 



Eln 



ZN+M{a') ZN+M{a) ZN{a) 

Y,T,a'^i^^ ^aN+a, P2aM) Zn+m{o:') Zjv+M(a) 

y^^,.T(P m2 ,P m2 ,P„,_sjim_) ZN+M{a) Zn^o) 

" (N + M) " (JV+M) (JV + Af) 



We know that the third fraction will give ~(3fM. But is is also clear that 
if we take 

a = — {aN + a) 

the three parameters in the numerator of the first fraction tend to the cor- 
responding ones in the denominator, so that the first fraction is immaterial 
in the limit. Now notice that 

a'{N + M) ~ a{N + M) ~* aM + a 

and therefore thanks to Lemma ^ of Appendix IXI the contribution of the 
second fraction is 

{aM + a)A □ 

If we now write 

M P2c 

^exp(-/377) = Jl 2 cosh(/3^ J^T^j) =ci---cm 

a j=l i/=l 
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we can formulate p2ll as 

ClimElnf7Ar{ci ■ ■ ■ cm expK(a)} = M{-[3f + aA) + aA 

from which it is clear that each cavity field (more precisely each Cj) yields 
a contribution {—jSf + aA) in the limit. 

Notice that in the limiting structure not only the cavity fields are mutually 
independent, but they are independent of n as well. We have thus ob- 
tained the analogy with the result of F. Guerra regarding the Sherrington- 
Kirkpatrick modelEl . 



Conclusions 

It is important now to formulate in a complete manner the Parisi theory 
for diluted spin glasses^, and to deepen the analysis of the invariance 
properties of the optimal RaMOSt in order to characterize the solution. 
We plan to dedicate future work to this program. 



A Connectivity Shift 

Lemma 1 Let a'N = a{N + A) , with A/N ^ as N oo. Then, in the 
whole region where the parameters are uniquely defined 

limEln ^^^"'j = A[Elncosh(/3J) - V MlilEtanh^'V/JJ)] 
N ZN(a) 2n 

^ ' n—l 

Proof 

The proof is based on standard convexity arguments. 
For t e [0, 1], define 

a'f = a(l + t—) 

so that a[ ^ a as N ^ oo. 
We have 

At=Eln ^liMl = E In 17 exp(-/3K(atA)) 
ZN{a) 

Let us compute the t-derivative of A{t) 
d ^ d 

—At = E ^ — 7rQtA(?7T-)ln^exp(/?^ Ji^n^nJ 

m— r u—O 

Using the following elementary property 

^-^tcim) = C(7rtc(m - 1) - nt^im)) 
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we get 



^At = aAE ^ [TTatA{m - 1) - natA{m)] In ^ exp(/3 ^ Ji,Ti,^r/ J 

m— T u—l 

PctA 

= aAEln exp(/5Jr^^r/^) exp(/? Jiy'^i^'^iu) 

T y—1 

PctA 

-aAEln^cxp(/3 ^ Jvn^ri^) 

r u—1 

= aAE In fit exp(/3 Jri^T;^) 

where we included the i-dependent weights in the average fit . Now use the 
following identity 

exp{(3jTiTi) = cosh(/?J) + TiTi sinh(/3J) 

to get 

^At = aAElnf7i[cosh(/3J)(l + tanh(/3J)Tj,^T; J] 
We have already observed that 

so if we now expand the logarithm in power series, we see that the result 
does not depend on t in the limit of large N, because — > a and hence 
J7t — > Therefore integrating back against t from to 1 is the same as 
multiplying by 1. Thanks to the symmetric distribution of J we get the 
result, where the odd powers are missing. □ 

B Thermodynamic Limit 

Our new interpolation method should allow one to prove the existence of 
the thermodynamic limit (already proven in ref. [3]), for otherwise it would 
be quite weak. As a matter of fact, this theorem turns out to be elementary 
with our interpolation. 

It is well known that a sufficient condition for the existence of the 
thermodynamic limit is the sub-additivity of the free energy. In our context 
we want to measure the changes caused by adding the M additional spins 
to the cavity of size N and make sure that 

E In Zn^m > E In Zn + E In Zm 
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The natural start is therefore considering the following interpolation 
Eln^exp[-/3(iJw+M(to) + HnUI - t)a) + Hm{{1 - t)a))] = 

s 

We clearly proceed by splitting H^+m in the usual way, and we get this 
time a total of five Hamiltonians. In the i-derivative the parts in cosh(/3 J) 
cancel out, since the sum of the five coefficients of a is zero. The remaining 
terms are 

^ Etanh2"(/3J) „ 

-$t = -a 2^ '-Bn,t 

at ^-^ 2n 

n—l 

where 

Bn,t = {Y^[{i<l2nNf + 2q2nNq2nM + (g2„M)')t] - {qLN + qlnM)t} 

Now it is trivial to show that 

Bn,t = - ^^^^ A^Af (((72„ - q2nf)t < □ 

C Sum Rules and Trial Functions 

Consider the function $t defined in the previous section, then the funda- 
mental theorem of calculus implies 

E In Zn+m - E In = E In Zm + / — -dt 

Jo dt 

Dividing by AI and taking the Cesaro limit as N goes to infinity yields the 
following sum rule 

-(3f{f3, a) = -PfM{f3, a)~aY^ ^^^C lim / ((q2„ - q2nf)tdt 

n=l ^"^ ^ Jo 

which shows that the difference f — Jm is given in terms of the multi-overlap 
distance averaged over any optimal RaMOSt. 

If we instead use the fundamental theorem of calculus for Rm (t) defined 
in section 131 we get another sum rule 

r cu \ ^ Etanh^"(/3J) ^^. [\ . ^ 

-pjM ^ (^M[T<',ri,i^) ^ oc y Clmi / {{q2n ~ q2nj }tdt 

n=l ■^'J 

which explains, when M goes to infinity, the role of GmC"^, k) as trial 
function; minimizing it means finding optimal RaMOSt's (and therefore 
the free energy) and the multi-overlap locking (coalescence) described by 
Aizenman in the case of non-diluted models"^. 
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